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(57) Abstract 

Image compression and viewing 
are implemented. A DWT-based com- 
pression method uses a two- level mem- 
ory computer. The viewing method se- 
lects image areas in compressed form 
at multiple resolutions. For compres- 
sion, a plurality of discrete tile image 
subsets (118) is denned which form 
the complete image. Seamless wavelet- 
based image compression occurs by in- 
putting the tiles in a selected sequence 
to a DWT (120) routine. The resulting 
DWT coefficients are stored in a first 
primary memory and periodically are 
compressed (128) and stored in a sec- 
ondary memory (124). The sequence 
of DWT operations on the tiles effec- 
tively calculates a seamless DWT of 
the image. Data retrieval occurs by 
specifying a resolution and a region of 
the image for display (146). The subset 
of stored DWT coefficients correspond- 
ing to each requested scene is deter- 
mined and then decompressed for input 
to an inverse DWT (164) to form the 
display (166). Interaction (168) may 
occur with a pointing device on previ- 
ous retrieved displays. 



COcol 
71 



1L 
2 



^1,2 



^1,3 



^00.3 



M1,3 



M0,3 



M1.2 



M0,2 



^11,1 



3k 
2 



71 



(Orow 



SOOCID: <WO 971BS27A1 I > 



FOR THE PURPOSES OF INFORMATION ONLY 

Codes used to identify States party to the PCT on the front pages of pamphlets publishing international 
applications under the PCT. 



AM 


Armenia 


GB 


United Kingdom 


MW 


Malawi 


AT 


Austria 


GE 


Georgia 


MX 


Mexico 


AU 


Australia 


GN 


Guinea 


NE 


Niger 


BB 


Barbados 


GR 


Greece 


NL 


Netherlands 


BE 


Belgium 


HU 


Hungary 


NO 


Norway 


BF 


Burkina Faso 


IE 


Ireland 


NZ 


New Zealand 


BG 


Bulgaria 


IT 


Italy 


PL 


Poland 


BJ 


Benin 


JP 


Japan 


PT 


Portugal 


BR 


Brazil 


KE 


Kenya 


RO 


Romania 


BY 


Belarus 


KG 


Kyrgystan 


RU 


Russian Federation 


CA 


Canada 


KP 


Democratic People's Republic 


SD 


Sudan 


CF 


Central African Republic 




of Korea 


SE 


Sweden 


CG 


Congo 


KH 


Republic of Korea 


SG 


Singapore 


CH 


Switzerland 


KZ 


Kazakhstan 


SI 


Slovenia 


CI 


Cote d'lvotre 


LI 


Liechtenstein 


SK 


Slovakia 


CM 


Cameroon 


LK 


Sri Lanka 


SN 


Senegal 


CN 


China 


LR 


Liberia 


sz 


Swaziland 


cs 


Czechoslovakia 


LT 


Lithuania 


TD 


Chad 


cz 


Czech Republic 


LU 


Luxembourg 


TG 


Togo 


DE 


Germany 


LV 


Latvia 


TJ 


Tajikistan 


DK 


Denmark 


MC 


Monaco 


TT 


Trinidad and Tobago 


EE 


Estonia 


MD 


Republic of Moldova 


UA 


Ukraine 


ES 


Spain 


MG 


Madagascar 


UG 


Uganda 


Fl 


Finland 


ML 


Mali 


US 


United States of America 


FR 


France 


MN 


Mongolia 


UZ 


Uzbekistan 


GA 


Gabon 


MR 


Mauritania 


VN 


Viet Nam 



SOOCtD: <WO 971B527A1J _> 



WO 97/18527 



PCT/US96/I7267 



STORAGE AND RETRIEVAL OF LARGE DIGITAL IMAGES 

BACKGROUND OF THE INVENTION 
5 This invention relates to digital imaging and, more particularly, to the storage and 

retrieval of data contained in very large digital images. This invention was made with 
government support under Contract No. W-7405-ENG-36 awarded by the U.S. 
Department of Energy. The government has certain rights in the invention. 

Many applications exist that require the storage and retrieval of very large digital 

10 images. Examples of such data sets include a Landsat Thematic Mapper (TM) scene, 
a mosaic of digital orthophotos (digitized aerial photographs), or a high resolution scan 
of a photographic negative. As used herein, the term "image" means any large two- 
dimensional array of numeric data even rf that data may not typically be referred to as 
an "image," e.g., digital elevation data. 

15 Due to the prodigious amounts of data present in such images, data 

compression is of significant importance to improve the utilization of computer storage 
and transmission resources. The image dimensions under consideration are 
significantly larger than can be viewed on a computer monitor. If a user can only view 
image subsections at full resolution, a display may contain less than one percent of the 

20 image. Under such circumstance, it is difficult to form in the viewer an overall picture of 
the image or to locate particular features of interest. Viewing the image at less than full 
resolution permits larger regions of the image to be displayed or even an entire image. 

Certain computer-implemented image data compression schemes used in the 
prior art are subband coding techniques, discussed in more detail below. The image 

25 data is separated into a number of subimages that are referred to as "subbands" since 
each contains information from a different band of spatial frequencies in the image. 
Compressing the subbands separately facilitates matching the overall compression 
algorithm to the image statistics. A recent mathematical development, the discrete 
wavelet transform (DWT), has significant theoretical overlap with the methods 

30 developed for generating the image subbands. For this reason, the term "subband 
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decomposition" has come to be synonymous with a DWT. This terminology is used 
here. 

For very large image dimensions complications arise in the computation of the 
DWT. The prior art discusses techniques for implementing the DWT where it is implied 
5 that the entire image data array is stored in computer main memory and that the 

computer-processed algorithm can readily access all of the image pixels. For very large 
images the memory involved in performing a DWT can become prohibitive. For 
example, consider an image that is of dimension 50,000 x 50,000 pixels, i.e., consisting 
of 2.5 billion pixels. If the transform is implemented in 32-bit precision floating point 
10 arithmetic then 10 gigabytes of computer memory are required (not including work 

space). Clearly, some method is required for paging data from computer memory and 
computing the DWT in sections. Although one could divide the image array into 
rectangular subsections and perform a DWT on each of these independently, this would 
be undesirable for two reasons. First, there would be wavelet transform boundary 
1 5 conditions in the interior of the image data which could potentially result in compression 
artifacts. Furthermore, the implementation of a local multiscale retrieval routine is 
complicated by these interior boundaries. 

In accordance with the present invention, a method is provided for the seamless 
wavelet-based compression of very large contiguous images and for accessing arbitrary 
20 locations in the image at a variety of resolutions. 

Accordingly, it is an object of the present invention to provide for retrieving from 
the compressed representation an image subsection from any location within the image 
with dimensions that are suitable for display. 

It is another object of the present invention to permit a user to interactively 
25 specify image regions for display and rapidly retrieve the image regions. 

Yet another object of the present invention is to permit the user to navigate, or 
"browse," over the database forming the image. 

One other object of the present invention is to provide for recalling the image at a 
variety of resolutions. 
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Additional objects, advantages and novel features of the invention will be set 
forth in part in the description which follows, and in part will become apparent to those 
skilled in the art upon examination of the following or may be learned by practice of the 
invention. The objects and advantages of the invention pnay be realized and attained 
5 by means of the instrumentalities and combinations particularly pointed out in the 
appended claims. 

SUMMARY OF THE INVENTION 
To achieve the foregoing and other objects, and in accordance with the purposes 

10 of the present invention, as embodied and broadly described herein, this invention may 
comprise (1) a method for performing DWT-based compression on a large digital image 
with a computer system possessing a two-level system of memory and (2) a method for 
selectively viewing areas of the image from its compressed representation at multiple 
resolutions and, if desired, in a client-server environment. The two-level memory 

15 system refers to primary and secondary memories. The primary memory is typically 
much smaller than the secondary memory but is more accessible by the processor. 

The compression of a large digital image l(x t y) is accomplished by first defining a 
plurality of discrete tile image data subsets T^x.y) that, upon superposition, form the 
complete set of image data l(x,y). A seamless wavelet-based compression process is 

20 effected on l(x t y) that is comprised of successively inputting the tiles T^x t y) in a 

selected sequence to a DWT routine, adding corrections that are passed from previous 
invocations of the DWT routine on other T h (x,y) % and storing the resulting DWT 
coefficients in a first primary memory. These coefficients are periodically compressed 
and transferred to a secondary memory to maintain sufficient memory in the primary 

25 memory for data processing. In the absence of the compression step, the sequence of 
DWT operations on the tiles T^x.y) effectively calculates a seamless DWT of l(x s y) that 
can be viewed as an "overlap-add" realization of the DWT. The seamless DWT 
process transforms l(x t y) to a set of DWT coefficients to form a set of subbands that 
embody a hierarchical representation of low-resolution representations of the image 

30 data array l(x,y). 
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Data retrieval consists of specifying a resolution and a region of l(x,y) for display 
The subset of stored DWT coefficients corresponding to each requested scene is 
determined and then decompressed for input to an inverse DWT, the output of which 
forms the image display. The repeated process whereby image views are specified 
5 may take the form an interaction with a computer pointing device on an image display 
from a previous retrieval. 



BRIEF DESCRIPTION OF THE DRAWINGS 
The accompanying drawings, which are incorporated in an d form a part of t he 

specification, illustrate the embodiments of the present invention and, together with the 

description, serve to explain the principles of the invention. In the drawings: 

FIGURE 1 is a schematic diagram of a prior art two-channel forward (analysis) 
and inverse (synthesis) discrete wavelet transformation (DWT) of an input data array. 

FIGURE 2 is a schematic diagram of a two dimensional DWT process realized 
with multiple applications of the analysis portion of the system shown in FIGURE 1. 

FIGURE 3 illustrates the four subbands formed from an image array by 
application of the DWT shown in Figure 2. 

FIGURE 4 illustrates the frequency support of a subband decomposition 
resulting from repeated applications of the system shown in Figure 3. 

FIGURE 5 is a flow diagram for DWT data compression according to one 
embodiment of the present invention. 

FIGURE 6 is a flow diagram for decompressing data according to one 
embodiment of the present invention. 

DETAILED DESCRIPTION OF THE INVENTION 
The present invention is concerned in part with a computer-implemented 
subband compression scheme for large images. The advantageous use of a two-level 
system of computer memory provides for the efficient local computation of the DWT in 
conjunction with a spatially adaptive coding scheme, allowing seamless image 
compression with minimal memory requirements. Furthermore, the invention provides 
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for rapidly retrieving image views of arbitrary dimension and location at a variety of 
resolutions from the compressed data. 

The invention advantageously uses the DWT for two purposes. The DWT is 
used as a preprocessing step in a computer to facilitate data compression. The 
5 subdivision of the input image data array into a set of image subbands that are coded 
separately facilitates matching the compression algorithm to the image statistics. 
Moreover, the DWT is also used to provide for multiscale data retrieval. Due to the 
multiresolution nature of the DWT, a description of the image at a variety of resolutions 
is inherent in the DWT decomposition, thus facilitating multiscale retrieval of the 
10 compressed data in accordance with the present invention. 

DEFINITIONS 



columns: Samples per line in an image. 

compressed data: Either compressed image data or table specification data or 



15 



both. 



compression: Reduction in the number of bits used to represent source image 



data. 



(digital) image: A two-dimensional array of data. 

downsampling: A procedure by which the spatial resolution of an image is 



20 



reduced. 



DWT: (discrete wavelet transform) A linear transformation, implemented by a 
multirate filter bank, that maps a digital input signal to a collection of output 



subbands. 



30 



25 



Huffman coding: An entropy coding procedure that assigns a variable length 
code to each input symbol. 

Huffman table: The set of variable length codes required in a Huffman coder. 
image data: Either source image data or reconstructed image data. 
lossless: A descriptive term for encoding and decoding processes and 
procedures in which the output of the decoding procedures(s) is identical to the 
input to the encoding procedure(s). 
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RGB images: A "red-green-blue" image, i.e., a digital image that is stored as 
three monochromatic images, each of which represents one of the three primary 
color components. 

quantization table: The set of quantization values (i.e., bin widths) used to 

quantize DWT coefficients within the subbands. 

quantize: The act of performing the quantization procedure for a DWT 

coefficient. 

sample: One element in the two-dimensional array that comprises an image. 
upsampling: A procedure by which the s patial resolution nf_an_im ff3e i g 



10 increased. 

PRIOR ART SUBBAND CODING 

The first stage in a computer implementation of a DWT-based lossy image 
compression algorithm entails a DWT decomposition Of the input image. In the case of 

15 multispectral imagery (which includes RGB images), an interspectral transform may be 
applied at this stage immediately before or after the DWT. Following the image 
transformation, the DWT coefficients are quantized. This is the lossy portion of the 
algorithm and maps the DWT coefficients into a stream of quantizer indices. Finally, 
the stream of quantizer indices are compressed with a lossless technique. Image 

20 decompression is achieved by inverting the lossless compression, decoding the 

quantizer symbols, and then performing an inverse DWT. A discussion of the use of the 
DWT in image compression can be found in J. N. Bradley et al., "The Wavelet-Scalar 
Quantization Compression Standard for Digital Fingerprint Images," Proc. of IEEE 
International Symposium on circuits and Systems, May 31-June 2, 1994. 

25 Figure 1 is a flow diagram of a computer processor implementation for a one- 

dimensional forward (analysis) and inverse (synthesis) DWT and forms a basic building 
block in the two-dimensional DWT implementation used in the invention. The input to 
the analysis section is the discrete-time signal x 10 to analysis section 12 and 
synthesis section 14 The discrete-time sequences A 0 26 and A, 28 are the output 

30 subband signals from the analysis section and form the input to synthesis section 14. 
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The systems h 0 16 and h 1 18 form a lowpass-highpass finite impulse response (FIR) 
filter pair that separates the low and high frequency components of xK) . The systems 
22 and 24 denoted by 12 are "downsamplers" that discard every second sample in the 
filter outputs. The analysis system is said to be "critically sampled", i.e., data is output 
5 from the system at the same rate as it is input. Due to the downsampling operations 22 
and 24, A 0 26 and A, 28 are full band signals that embody, respectively, the low and 
high frequency information in x 10 . 

The process shown in Figure 1 also inputs the subband signals A 0 26 and A, 28 
to a synthesis section 14 that synthesizes the signal i 42. The systems h 0 ' 36 and h; 
10 38 form another lowpass-highpass FIR filter pair and the systems 32 and 34 denoted by 
f 2 are "upsamplers" that increase the signal sampling rate by inserting a zero between 
samples. If the four digital filters, h Q 16 and h, 18, and h 0 ' 36 and /i/ 38. shown in 
Figure 1 1 are chosen appropriately, x 42 is equal to x 10, i.e. synthesis section 14 
shown in Figure 1 inverts the operation performed by analysis section 12. 
15 Separable realizations are often used for the two-dimensional DWT analysis and 

synthesis procedures, i.e., implementations where the corresponding one-dimensional 
procedure shown in Figure 1 is applied separately to each image row and column. 
Figure 2 depicts a separable two-dimensional forward DWT. The analysis system of 
Figure 1 is first applied to each row of image / 50 through FIR filter pair h 0 52 and h, 54, 
20 with downsamplers 56 and 58 to split each row into a lowpass and highpass subband. 
The lowpass subband from each image row is written as a row into the temporary array 
Aq 62. Similarly, the highpass subband of each row is written as a row in the temporary 
array A/ 64. 

The columns in each temporary array are then each processed with a one- 
25 dimensional DWT of Figure 1 . The lowpass subband array A 0 ' is processed through 

FIR filter pair h 0 66 and h f 68, with downsamplers 76 and 78 to further split each column 
into lowpass-lowpass and lowpass-highpass subbands. The highpass subband array 
A/ is processed through FIR filter pair h 0 72 and h 1 74 t with downsamplers 82 and 84 to 
further split each column into highpass-lowpass and highpass-highpass subbands. 
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This basic system shown in Figure 2 thus splits the input image I^A^ into four 
subbands, A^, 86, A 011 88, A 101 92, A U1 94, with appropriate frequency supports as 
illustrated in Figure 3. In this A; jk subband notation, the / and j subscripts denote the 
filter path that was used in their creation. The first subscript refers to the row operation 
5 and the second to the column operation with a "0" indicating a lowpass operation and 
"1" a highpass operation. For example, subband A 10 92 is created by a highpass 
filtering on the image rows followed by lowpass filtering on the columns of ^4/64. The 
image is resolved into four subbands that contain different frequency components of the 

originaUmage-frornwhich the original image can be synthesizedras di^ussed for^ 

10 Figure 1. 

Finer frequency partitions are produced by cascading the system of Figure 2. 
Typically, the lowpass-lowpass subband is repeatedly output to this same process, 
resulting in an "octave-scaled" decomposition. Figure 4 illustrates the frequency 
support of a subband decomposition resulting from three cascades. The third subscript 

15 in the subband notation denotes the level of recursion in the decomposition. Let L 
denote the number of levels in the cascade. Note the A 00s for 1<s<L exist at 
intermediate stages of the process. 

It is sometimes convenient to express the octave-scaled DWT of l(x,y), i.e., the 
collection of subbands A iJk (u,v) as /(j,w,v) , where s denotes a one dimensional 

20 ordering of the subbands. For example, in the subband notation shown in Figure 4, 

s=i+2j+3(L-k) 1 and t(0,u,v), t(1,u,v)=A 0XL (u.v) 1(3L,u f v)=A u1 (u,v). 

The input to the one-dimensional DWT depicted in Figure 1 is assumed to be of 
infinite duration. Effecting the DWT on a finite length signal, e.g., an image row or 
column, necessitates the definition of transform boundary conditions. The boundary 

25 conditions define a signal extension, i.e., a definition of the signal outside of its domain. 
A boundary condition that is commonly used is the periodic extension in which the finite 
length signal is viewed as one period of an infinite periodic waveform. Another example 
is zero boundary conditions in which the signal is viewed as padded with zeros. Yet 
another example is reflected boundary conditions where the signal is extended by 

30 performing a mirror image of the data. 
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SUBBAND DECOMPOSITION OF LARGE IMAGES 

The invention consists of two main procedures: a compression routine and a 
decompression (browsing) routine. The compression routine proceeds in a similar 
5 fashion as WSQ compression with the advantageous use of a two-level system of 
memory to accommodate the large image dimensions. In accordance with one aspect 
of the invention, the image is subdivided into a number of tiles, each of which is 
processed by a DWT routine. The DWT routine uses tile-dependent boundary 
conditions and data transfers with invocations of the DWT routine on other image tiles 

10 to effectively produce the same output as the DWT routine would output if applied to the 
entire image while providing a more advantageous usage of both primary and 
secondary memory. The process can be viewed as an overlap-add implementation of 
the DWT. The preferred implementation of the invention is based on the four-channel 
separable DWT of Figure 2. Clearly, non-separable and M-channel filter banks are also 

15 applicable. 

The Compression Routine 

Referring now to Figure 5, the compression routine outputs the compressed data 
in a compressed image data (CID) file which is structured for rapid local multiscale 
retrieval. The image data is assumed to exist on secondary memory, e.g., a computer 

20 hard drive memory, and may be contained in a single file or as a mosaic of subimages 
with each subimage contained in a separate file. The image data is denoted by l(x t y), 
where x and y are integers such that 0 < jc < Wi and 0<y <Hj . The tile images are of 
the same dimensions as l(x,y) but have support restricted to a W t x H t subset of the 
(x,y) coordinates. More specifically, 



25 




where 




and where the four comers of a tile are given by 
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'00,// = iW t 

'01,// = min((/>l)»J-K»J.,) 
'10,//=/7/, 

tlUj = min(0>l)// / -l,/y / _ 1 ). 
The number of tile images is given by 



m II 



There are no restrictions on the image dimensions and it is not necessary that W { be 



— 5— divisibte-by t^or that Hrbe-divisible bynW^TRelile images for / = [»j/0j"|_i and 

j = f Hi I H^- 1 are allowed to have support regions smaller than W t x H ( . The present 
invention recognizes that /(x,yj can be represented as a superposition of the tiles, 
where 

' j 

10 and since the DWT is a linear transformation, the DWT of l(x,y) can be obtained by 
summing the DWTs of the T^(x f y) % i.e., 

/(^ w ,v) = ^^7j y (^^v), (1a) 

' J 

where s is defined above. As will be described below, performing a DWT separately on 
the tile images allows for a DWT-based compression to occur on the image with 
15 minimal memory requirements. 

The Tjj are processed sequentially in the compression routine. This requires a 

one-dimensional ordering of the 7~ that is denoted by 0(r) = (i 9 j) . (That is, the r th 
image tile to be wavelet transformed is 7#( r ).) The sum in Eqn. (1a) is not evaluated 

following the computation of all fy(s,u,v) . Rather, this sum is updated after each t 
20 iteration as 

r 

/ r (j,«,v)= v )- (2) 

/=1 
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After a given ^ r )(^,w 5 v) has been calculated, this update involves only those 

(j,m,v) esupp[f^ r j(j,M,v)]. (Note that since h 0 and h, are FIR that the J-j have finite 

support). In the compression routine, the result from Eqn. (1a) is never stored in its 
entirety. Periodically, some or all of the DWT coefficients are compressed and written to 
5 secondary memory. Those coefficients eligible for compression are 

{%r)(^ v )| fy r )(*,K,v) = H s ^v)}- (3) 

By sequentially effecting a DWT on each image tile and updating the sum in Eqn. (2), a 
DWT-compression of the entire image can be effected with an efficient use of primary 
memory. 

10 The compression routine is parameterized by W it H„ W tl and H t as well as the 

number of levels L in the subband decomposition; a bit-rate parameter R that specifies 
the compression ratio; and the analysis filters h 0 and h,. A flow chart of the 
compression process is depicted in Figure 5. The routine 110 is started 112 with t=1 
and consists of a loop 136 indexed by t that iterates on the T # . The first routine 

15 encountered in the loop is Extract Tile 118 . which reads the pixel values contained in 
supp[7V] from the image data and stores them in primary memory. The image tile is 
stored in a data structure that contains a description of its support as well as a pointer 
to the pixel values. 

Subroutine DWT 120 (Discrete Wavelet Transform) is then invoked. In practice 
20 the DWT of each T H is not effected by operating on the zero-padded W k x H, array. It is 
only necessary to provide memory for those values of T^(x t y) where 

(x,y) <= supply (x,>')j . The one-dimensional DWT routine operates on the rows and 

columns of the tile data array with appropriate boundary conditions. The boundary 
conditions employed in the various calls to the one-dimensional DWT routine are 
25 dependent upon the location of tile T i} in /. Reflected boundary conditions are used if the 
corresponding boundary of 7", coincides with a boundary of /, otherwise zero boundary 
conditions are used. Note that DWT 120 effects an expansive transform, that is, the 
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number of nonzero coefficients emanating from the routine is generally greater than the 
number of pixels that are input to it. 

Subroutine Add Coefficient 122 is invoked to retrieve the data transfers for f . 
and that were stored on primary or secondary memory by an invocation of 
5 subroutine Xfer Data 126 (see below) for an earlier iteration of r, and then adds them to 
f iy j , effectively performing the update in Eqn. (2). Note that this process implies a 
restriction on d. Clearly, processing on 7}j{x,y) cannot proceed if it has not already 
occurred-on-tiles-7/i^(^)^n^"7; j yZ7(^j: — 

Subroutine Archive Coefficient 124 is then invoked, which stores in primary 
1 0 memory those wavelet coefficients in Eqn. (3) that were not stored earlier in a 

coefficient archive. Subroutine Xfer Data 126 stores the data that is recalled in later 
calls to Add Coef. 122. Two data segments are stored: those that are used when Add 
Coef. 122 is called for T t y> , 

{% («. v )|(«. v) e suppfl-j ] U su PP [7} + 1 j ]} 

1 5 and those that are used when Add Coef. 122 is called for T, >f 

{%•("- v)|(ii,v)esupp[^]nsupp[ f i+ ij ]-supp7/ +1>y -}. 

The data transfers are accomplished via temporary storage on either primary or 
secondary memory. Note that it is assumed that 

supply ]nsupp[7} +2j y] = <f> 

20 and 

SUPp[%]nsupp[7} 5 y +2 ] = <* 

for all / and j. 

Periodically, in subroutine Compress Coefficient 128 . some or all of the DWT 
coefficients in archive are compressed and written to secondary memory, i.e., they are 
25 dumped. Thus, the compression routine proceeds with primary memory continuously 
being allocated in Archive Coef. 124 and freed in Compress Coef. 128. The t index is 
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then indexed 132 to t+1 and the loop is repeated 136 until x=T 138, i.e., the number of 
tiles, and the routine is terminated 138 . 

In the preferred implementation of the invention, the compression includes scalar 
quantization followed by zero-run length and Huffman coding of the quantizer indices. 
5 (Other quantization strategies and lossless coding procedures are clearly applicable at 
this point.) The scalar quantization requires that a bit allocation be performed that 
selects a bin-width for each subband based on local image statistics. For a given dump 
it is preferred that all subband statistics correspond to roughly the same region in /. 
Although a particular dump may not involve compression of coefficients from all 

10 subbands, statistics from all subbands will be utilized in performing an overall bit 

allocation. The result is a spatially adaptive image compression scheme with the scalar 
quantizer bin widths and the Huffman codeword lengths a function of spatial location on 
the image. The number of invocations of DWT 120 between dumps is subband 
dependent. On each coefficient dump a single Huffman table is generated for each 

15 subband that is output. 

A two-level hierarchy of coefficient blocking is used in the compression process. 
The first level is necessitated by the fact that the wavelet coefficient archive must be 
periodically purged (Compress Coef 128) . whereupon a rectangular subsection of a 
subband (i.e., a block) is coded. Moreover, before a dump occurs, each subband block 

20 that is output is blocked further into smaller subblocks. The second level of blocking is 
to provide for fast access to an arbitrary section of the CID file during image browsing. 
Upon output in secondary memory, the larger block is referred to as a Huffman block 
and has header information that describes the Huffman table, the quantizer 
characteristic, the block support, and an offset table describing the relative offset in the 

25 compressed data record of each subblock. The smaller block is referred to as a 
Huffman subblock. Each Huffman subblock within a particular Huffman block is 
typically compressed with the same quantizer characteristic and Huffman table. The 
CID file has an offset table that describes the offset of each compressed Huffman 
block. 

30 The Browse Routine 
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The browse routine 140 shown in flow diagram form in Figure 6 accesses the 
CID computer memory file generated by compression routine V\0 shown in Figure 5 
and generates pixel values for a sequence of window displays. The procedure has the 
capability for operating in a distributed environment, i.e., where the data is to be 
5 decompressed on a different computing platform than where the CID file resides. The 
client computer sends requests to the server computer that in turn transmits 
compressed data necessary for synthesizing a monitor window display. The client 
computer performs the operation of decompressing the received data and creating the 
computer monitor display. The routine on the client comp uter side provide fnr_tfc^ 

10 management of a cache memory that contains data from previous accesses to the CID 
file. Any requested data contained in the cache may be retrieved from cache memory 
instead of from the server computer. The caching scheme is advantageous when an 
application is limited by transmission bandwidth and is not typically used when the 
decompression executable file and the CID file reside on the same platform. 

15 Since the subbands A WiS for 0<s<L are obtained by repeated applications of 

lowpass filtering and two-fold downsampling, they form low resolution representations 
of the original image data. Browse routine 140 exploits this multiscale property of the 
subband decomposition. When specifying a view, the user is restricted to selecting a 
resolution that is a power-of-two times the original image resolution. The display 

20 generation then involves the synthesis of the appropriate subsection of from the 
CID file. Thus, browse routine 140 extracts a relatively small subset of the wavelet 
coefficients that is then input to an fL-sJ~level inverse DWT. 

A request for data from subband A iJS (x,y) is described by the set of (x,y) 
coordinates defining the subregion to be extracted. This set is denoted by a ijs where 

25 °ij\s = {{ x >y)\ x y\sjo ^ x ^ x o\s n i » yy,s 9 o ^ y ^ yij^x] • 

Note that since the window is assumed to be rectangular the a ijs are rectangular also. 
Recall that a view at scale s requires wavelet coefficients from A^. For s*L these 
coefficients are not stored explicitly but must be synthesized from a subset of the 
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coefficients contained in the CID file. The request specifies subsets a iJS for (s,ij) in K 
where A' = {0 ? 0,0}U{(0.1,/),(K0,/),(KK/)|5 < / < l] . 

An overview of browse routine 140 is shown in Figure 6. Procedure 140 is 
initiated 142 and begins by reading header information 144 from the CID file that 
describes the overall structure of this file. The structure information includes the 
number of levels in the subband decomposition, the image width and height, the 
supports and coefficient values of the synthesis filters, and an offset table describing 
the locations of table data and compressed data records. The procedure then invokes 
subroutine Select View Parameters 146 where the parameters specifying a view 
request are input. These parameters include the resolution s and the window support 

At this point subroutine Determine Supports 148 is invoked, which evaluates the 
sets a ijs specifying the wavelet coefficients that must be synthesized from the CID file. 
The subsets at level s are related to a^., by the following 



-Viy.5.0 = 



x oo.j-i.o h\ 



>Wj-i.o h\ 



>Wj-U ~~ ho 



where the support of the synthesis filters is given by 

supp{fy} = [/oo»'oi] 
supp{/q} = [/to,/ll] 

Subroutine Determine Supports 148 entails the evaluation of these equations for s<l<L. 

The cache exists on the client and is composed of a cache memory and a cache 
table. The cache memory contains data from previous subrequest transmissions from 
the server. For each entry in cache memory there is a cache table entry describing its 
support. The support of the t-th cache entry for subband A ijs is denoted by the cache 



SOOCIO: <WO 9718527A1J_» 



WO 97/18527 



PCT7US96/17267 



16 

table entry e^,. After a window request is made, subroutine Cache Query 152 (see 
Figure 7) accesses the cache table and generates a description of the requested data 
that is contained in cache memory. Clearly, during the first call to Cache Query 152 the 
cache will be empty. The cache data entries will typically be Huffman compressed 
coefficient indices but may also contain decompressed wavelet coefficients. The cache 
data entries may exist on primary or secondary memory. 

For subband A ijs , zero or more cache entries exist. The support of the cache 
table entries , denoted by e lj s l , for describe the subset of wavelet coefficients 

contained in the corresponding <acbe_memory-entry_T-hfi-dat^-frorn^\— that mucrbc — 
obtained from the server is given by 

for all (sj,j) € A' , 

where 

R ij.s = <*ij,sn<*ij 9 s n(^y e ijsl j . 

This describes the subset of A t/5 required for display that is not present in cache 
memory. The data that is then transferred from the CID file on the client to the server 
are the records having support r ij5l such that 

r O\sJr*R ijs *0- 

These records may be Huffman subblocks or some subset thereof. 

Following Cache Query 152 the client transmits 154 the request and waits for the 
requested data. The server sends 154 the request in the form of a packet of 
subrequests, each of which consists of compressed data of a rectangular region from a 
particular subband. The subrequests are received 156 and subroutine Update Cache 
158 stores the subrequests from the data transfer in cache memory, purges the least 
recently used cache entries, and records each cache hit encountered in Cache Query 
152 . Subroutine Synthesize Subbands 162 is then invoked to decompress the quantizer 
indices from the compressed data in the request transfer and reconstructs the wavelet 
coefficients. The procedure then invokes subroutine DWT Inverse 164 . which 
synthesizes the required subset of oqq s . 
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But DWT Inverse 164 does not calculate the actual pixel values that are used in 
the window display. This is done by Create Window Pix 166 with the data output by 
DWT Inverse 164. As an example, the output of DWT Inverse 164 may be in floating 
point format in which case Create Window Pix 166 casts these values to one-byte 
5 words (after a possible rescaling). In another case, the data retrieved may be two-byte 
words containing, e.g., elevation data. Create Window Pix 166 in this case may 
generate a shaded relief view of the data. At this step in the browse procedure, if 
another window is requested 168 the procedure returns 172 to subroutine Select View 
146 . Otherwise, the program is terminated 174 . 

10 The decompression routine discussed above limits the obtainable browse image 

resolution to a power-of-two times the original image resolution. The generation of 
arbitrary resolution can be provided by retrieving the closest power-of-two resolution 
greater than that requested and then performing an interpolation process. 

The invention is primarily intended for use in an interactive application. Initially, 

15 the user views a low-resolution representation of the image on a computer monitor that 
provides an icon of a large portion of f or perhaps the entire, image scene. By using a 
computer pointing device, such as a mouse, the user can interact with the low 
resolution image to specify a region and length scale (an image view) for display. 
These parameters are then passed to the decompression routine which retrieves the 

20 desired view. This process may be repeated with the user interacting with the original 
low-resolution scene or with subsequent images returned by the decompression 
routine. During such repeated applications of the decompression routine, the invention 
also allows for the management of an image cache to store the results of previous data 
accesses. By utilizing the image cache, the process described herein needs only to 

25 retrieve that data requested by the query that is not in cache memory. The caching 
scheme is particularly advantageous if the data is being accessed over a data link that 
is slow compared to the computational time associated with the decompression 
processing. 

It will be understood that the above description and the claim nomenclature is 
30 presented in a two-dimensional representation for ease of description and 
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nomenclature. The process is equally applicable to a one-dimensional process and a 
three-dimensional process. Only the designation of subscripts is different and the use 
of two-dimensional nomenclature should not be construed as limiting the scope of the 
claimed invention. 

5 The foregoing description of the invention has been presented for purposes of 

illustration and description and is not intended to be exhaustive or to limit the invention 
to the precise form disclosed, and obviously many modifications and variations are 
possible in light of the above teaching. The embodiments were chosen and described 

in order to best explain the principles of the invention and its practical application 

10 thereby enable others skilled in the art to best utilize the invention in various 
embodiments and with various modifications as are suited to the particular use 
contemplated. It Is intended that the scope of the invention be defined by the claims 
appended hereto. 
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WHAT IS CLAIMED IS: 

1 A method for selectively viewing areas of an image at multiple resolutions 
in a computer having a primary memory for data processing and a secondary memory 
for data storage, the method comprising the steps of: 
5 storing a complete set of image data array l(x,y) representing said image in a 

first secondary memory of said computer; 

defining a plurality of discrete tile image data T i} (x r y) subsets, where sard 
complete set of image data l(x,y) is formed by superposition of said discrete tile image 
data T k {x,y)\ 

10 performing one or more discrete wavelet transformation (DWT)-based 

compression processes on each said tile image data T i} (x,y) in a selected sequence to 
output each said discrete tile image data T i} {x,y) as a succession of DWT coefficients in 
a succession of subband sets, where one subband of each set is a low-resolution 
representation of said discrete tile image data T if (x f y) to form a sequence of low- 

15 resolution representations of said image data array l(x t y) to selected resolutions; 

maintaining updated sums of said DWT coefficients from said discrete tile image 
T#(x,y) to form a seamless DWT of said image and storing said sums in a first primary 
memory location of said computer; 

periodically compressing said sums and transferring said compressed sums to a 

20 second secondary memory to maintain sufficient memory in said primary memory for 

data processing, wherein said second secondary memory contains stored DWT wavelet 
coefficients; 

selecting a viewing set of said image data array l(x,y) to be viewed at a desired 
resolution: 

25 determining a viewing subset of said stored DWT wavelet coefficients that 

support said viewing set of said image data at said desired resolution; and 

forming from said subset of said stored DWT wavelet coefficients a computer 
display of said viewing set of said image data at said desired resolution. 
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2. A method according to Claim 1 , wherein the step of performing one or 
more DWT of each said tile image data includes the step of setting all image data value 
to zero outside said tile image data to form a tile data array that is supported only over 
said tile image data subset T^x.y) and performing said DWT over said entire tile data 
array. 

3. A method according to Claim 1 , where said selected sequence for 
performing said DWT compression on said tile image data T^x.y) is to compress tile 
image data T^/x.y) and T iH (x,y) before compressing T/x,y). 

4. A method according to Claim 2, where said sele cted segugnrpfnr 



10 performing said DWT compression on said tile image data T^x.y) is to compress tile 

image data T^/x.y) and T^fx.y) before compressing T^x.y). 

5. A method according to Claim 1 , wherein the step of maintaining updated 
sums of said DWT coefficients includes the step of retrieving updated sums of DWT 
coefficients for T y .,/x,y; and T^fx.y) and adding to coefficients for T„(x,y). 

15 6. A method according to Claim 2, wherein the step of maintaining updated 

sums of said DWT coefficients includes the step of retrieving updated sums of DWT 
coefficients for T M /x,y; and T iH (x,y) and adding to coefficients for TJx.y). 

7. A method according to Claim 3, wherein the step of maintaining updated 
sums of said DWT coefficients includes the step of retrieving updated sums of DWT 

20 coefficients for T^/x.y) and T ih1 (x,y) and adding to coefficients for TJx.y). 

8. A method according to Claim 4, wherein the step of maintaining updated 
sums of said DWT coefficients includes the step of retrieving updated sums of DWT 
coefficients for T^/x.y) and T^x.y) and adding to coefficients for T^x.y). 

9. A method according to Claim 1 , wherein the step of selecting a viewing 
15 set of said image data l(x,y) to be viewed at a selected resolution comprises the steps 

of specifying a set of coordinates (x,y) from said image data array l(x,y) and reading 
related stored information that includes the number of resolution levels for said subband 
sets, image width and height, supports and coefficient values for synthesis filters, and 
an offset table describing the locations of table data and compressed data records. 
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10. A method according to Claim 1, wherein the step of selecting a viewing 
subset of said stored DWT wavelet coefficients includes the step of extracting wavelet 
coefficients corresponding to said viewing set and the corresponding synthesis filters for 
decompressing said wavelet coefficients. 

11. A method according to Claim 1 , further including the step of establishing a 
cache memory for storing decompressed wavelet coefficients for each said computer 
display that is formed. 

12. A method according to Claim 11, wherein the step of selecting a viewing 
subset of said stored DWT wavelet coefficients includes a first step of determining 
whether said coefficients are stored in said cache memory. 

13. A method for compressing a large digital image for storage in a computer 
memory, the method comprising the steps of: 

storing a complete set of image data array l(x,y) representing said image in a 
first memory location of said computer; 

defining a plurality of discrete tile image data T H {x,y) subsets of said l(x,y), where 
said l(x t y) is formed by superposition of said T^x t y)\ 

performing on a computer one or more discrete wavelet transformation (DWT)- 
based compression processes over each said tile image data T h {x,y) in a selected 
sequence to output each said T^x.y) as a succession of DWT coefficients in a 
succession of subband sets, where one subband of each set is a low-resolution 
representation of said T i} (x,y) to form a sequence of low-resolution representations of 
said l(x,y) to selected resolutions; and 

maintaining updated sums of said DWT coefficients from said discrete tile image 
T i} (x t y) to form a seamless DWT of said l(x,y) and storing said sums in a second 
memory location of said computer. 

14. A method according to Claim 13, further including the step of: 
periodically compressing said sums and transferring said compressed sums to a 

second secondary memory to maintain sufficient memory in said primary memory for 
data processing. 
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1 5. A method according to Claim 1 3, wherein the step of performing one or 
more DWT of each said tile image data includes the step of setting all image data value 
to zero outside said tile image data to form a tile data array that is supported only over 
said tile image data subset T v (x,y) and performing said DWT over said entire tile data 
array. 

16. A method according to Claim 13, where said selected sequence for 
performing said DWT compression on said tile image data T^x.y) is to compress tile 
image data T^/x.y) and T ih1 (x,y) before compressing T^x.y). 

17 A method according to Claim 15, where said selected sequence for 



10 performing said DWT compression on said tile image data TJx.y) is to compress tile 
image data T^/x.y) and T u Jx,y) before compressing T 0 (x,y). 

1 8. A method according to Claim 13. wherein the step of maintaining updated 
sums of said DWT coefficients includes the step of retrieving updated sums of DWT 
coefficients for T h1 /x,y) and T u ,,(x,y) and adding to coefficients for T^x,y). 

15 19. A method according to Claim 14, wherein the step of maintaining updated 

sums of said DWT coefficients includes the step of retrieving updated sums of DWT 
coefficients for T^/x.y) and T^x.y) and adding to coefficients for T lt (x,y). 

20. A method according to Claim 15, wherein the step of maintaining updated 
sums of said DWT coefficients includes the step of retrieving updated sums of DWT 

20 coefficients for T MJ (x,y) and T, H (x,y) and adding to coefficients for Ttfx.y), 
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21. A method for selectively viewing areas of an image at multiple resolutions 
in a computer having a primary memory for data processing and a secondary memory 
for data storage, the method comprising the steps of: 

storing a complete set of image data array l(x,y) representing said image in a 
5 first secondary memory of said computer; 

defining a plurality of discrete tile image data T^x.y) subsets, where said 
complete set of image data l(x,y) is formed by superposition of said discrete tile image 
data T^x t y)\ 

performing one or more discrete wavelet transformation (DWT)-based 
10 compression processes on each said tile image data T^x.y) in a selected sequence to 
output each said discrete tile image data T h {x,y) as a succession of DWT coefficients in 
a succession of subband sets, where one subband of each set is a low-resolution 
representation of said discrete tile image data T^x t y) to form a sequence of low- 
resolution representations of said image data array l(x,y) to selected resolutions; 
15 selecting a viewing set of said image data array l(x,y) to be viewed at a desired 

resolution: 

determining a viewing subset of said DWT wavelet coefficients that support said 
viewing set of said image data at said desired resolution; and 

forming from said subset of said DWT wavelet coefficients a computer display of 
20 said viewing set of said image data at said desired resolution. 

22. A method according to Claim 21, wherein the step of performing one or 
more DWT of each said tile image data includes the step of setting all image data value 
to zero outside said tile image data to form a tile data array that is supported only over 
said tile image data subset T tj (x f y) and performing said DWT over said entire tile data 

25 array. 

23. A method according to Claim 21 , where said selected sequence for 
performing said DWT compression on said tile image data T t {x,y) is to compress tile 
image data T,. u (x,y) and T iH (x,y) before compressing T^x t y). 
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24. A method according to Claim 22, where said selected sequence for 
performing said DWT compression on said tile image data TJx.y) is to compress tile 
image data T h1 /x,y) and T lH (x,y) before compressing T it (x,y). 

25. A method according to Claim 21 , wherein the step of selecting a viewing 
set of said image data f(x,y) to be viewed at a selected resolution comprises the steps 
of specifying a set of coordinates (x,y) from said image data array l(x,y) and reading 
related stored information that includes the number of resolution levels for said subband 
sets, image width and height, supports and coefficient values for synthesis filters, and 
an offset table describing the locations of t able data and rr,mp reS sed^3t3-rccord=: 



10 26. A method according to Claim 1 , wherein the step of selecting a viewing 

subset of said DWT wavelet coefficients includes the step of extracting wavelet 
coefficients corresponding to said viewing set and the corresponding synthesis filters for 
decompressing said wavelet coefficients. 

27. A method according to Claim 21 , further including the step of establishing 
1 5 a cache memory for storing decompressed wavelet coefficients for each said computer 

display that is formed. 

28. A method according to Claim 27, wherein the step of selecting a viewing 
subset of said DWT wavelet coefficients includes a first step of determining whether 
said coefficients are stored in said cache memory. 
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